Deep Learning Based Human Activity Recognition Using Spatio-Temporal Image Formation of Skeleton Joints
نویسندگان
چکیده
Human activity recognition has become a significant research trend in the fields of computer vision, image processing, and human–machine or human–object interaction due to cost-effectiveness, time management, rehabilitation, pandemic diseases. Over past years, several methods published for human action using RGB (red, green, blue), depth, skeleton datasets. Most introduced classification datasets are constrained some perspectives including features representation, complexity, performance. However, there is still challenging problem providing an effective efficient method discrimination 3D dataset. There lot room map joint coordinates into spatio-temporal formats reduce complexity system, provide more accurate system recognize behaviors, improve overall In this paper, we suggest formation (STIF) technique joints by capturing spatial information temporal changes discrimination. We conduct transfer learning (pretrained models- MobileNetV2, DenseNet121, ResNet18 trained with ImageNet dataset) extract discriminative evaluate proposed fusion techniques. mainly investigate effect three such as element-wise average, multiplication, maximization on performance variation recognition. Our deep learning-based outperforms prior works UTD-MHAD (University Texas at Dallas multi-modal MSR-Action3D (Microsoft 3D), publicly available benchmark STIF representation. attain accuracies approximately 98.93%, 99.65%, 98.80% 96.00%, 98.75%, 97.08% ResNet18, respectively.
منابع مشابه
Skepxels: Spatio-temporal Image Representation of Human Skeleton Joints for Action Recognition
Human skeleton joints are popular for action analysis since they can be easily extracted from videos to discard background noises. However, current skeleton representations do not fully benefit from machine learning with CNNs. We propose “Skepxels” a spatio-temporal representation for skeleton sequences to fully exploit the “local” correlations between joints using the 2D convolution kernels of...
متن کاملInformative joints based human action recognition using skeleton contexts
The launching of Microsoft Kinect with skeleton tracking technique opens up new potentials for skeleton based human action recognition. However, the 3D human skeletons, generated via skeleton tracking from the depth map sequences, are generally very noisy and unreliable. In this paper, we introduce a robust informative joints based human action recognition method. Inspired by the instinct of th...
متن کاملSpatio-Temporal Graph Convolution for Skeleton Based Action Recognition
Variations of human body skeletons may be considered as dynamic graphs, which are generic data representation for numerous real-world applications. In this paper, we propose a spatio-temporal graph convolution (STGC) approach for assembling the successes of local convolutional filtering and sequence learning ability of autoregressive moving average. To encode dynamic graphs, the constructed mul...
متن کاملDeep Forecast: Deep Learning-based Spatio-Temporal Forecasting
The paper presents a spatio-temporal wind speed forecasting algorithm using Deep Learning (DL) and in particular, Recurrent Neural Networks (RNNs). Motivated by recent advances in renewable energy integration and smart grids, we apply our proposed algorithm for wind speed forecasting. Renewable energy resources (wind and solar) are random in nature and, thus, their integration is facilitated wi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2021
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app11062675